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ROBUST  OPTIMUM  INVARIANT  TESTS  FOR  RANDOM  MANOVA  MODELS 

Rita  Das  and  Bimal  K.  Sinha* 

University  of  Pittsburgh 
and 

University  of  Maryland  Baltimore  County 
ABSTRACT 

Consider  the  canonical  form  MANOVA  setup  with  X:  nxp  =  * 

(MJ.M^.O)'  +  E,Xi  :  n^xp ,  i  =  1,  2,  3,  M..  :  n.xp,  i  =  1,  2,  +  n2  +  n3  = 

n,  n^  >_  p,  where  E  is  a  random  error  matrix  with  location  0  and  unknown 

scale  matrix  z  >  0(p.d.).  Assume,  unlike  in  the  usual  sense,  that  M^  is 

2 

random  with  location  0  and  scale  matrix  a^Z,  M^  is  either  fixed  or  random 

2  2  2 

with  location  0  and  a  different  scale  matrix  o^E ,  ,  a ^  being  unknown. 

2  2 

For  testing  Hq  :  =  0  versus  H^:  >  0  under  a  left  orthogonally  invar¬ 

iant  distribution  of  X,  it  is  shown  that  when  either  n^  =  0  or  M^  fixed 
if  n^  >  0  the  trace  test  of  Pillai  (1955)  is  UMPI  if  min(nj,p)  =  1  and  LB  I 
if  min(nj,p)  >  1.  The  test  is  null,  nonnull  and  optimality  robust  (Kariya 
and  Sinha  (1985)).  However,  such  a  result  does  not  hold  if  n^  >  0  and  M^ 
random . 

AMS  1980  Subject  Classifications:  Primary  62E10;  Secondary  62H05. 

Key  words  and  phrases:  Left  orthogonally  invariant  distribution,  locally 
best  invariant,  MANOVA  problem,  maximal  invariant,  mixed  effects  model, 
random  effects,  robustness,  spherically  symmetric  distribution ,  uniformly 
most  powerful  invariant,  Wijsman's  representation  theorem. 
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1.  INTRODUCTION 


TI  ■*  usual  MANOVA  model  in  the  canonical  form  consists  of  an  nxp 
random  data  matrix  X  decomposed  as  X  =  (XJ  ,X£ .X^)' with  X^  :  n.xp,  i  = 
1,  2,  3,  ni  +  n2  +  n3  =  n»  _>  p,  following  the  structure 


-  - 

r  i 

X1 

II 

Mi 

X2 

M2 

X3 

0 

- 

Here  M^  :  n^xp  is  the  mean  matrix  of  X. ,  i  =1,2,  and  E:  nxp  is 
the  random  error  matrix.  Under  the  distributional  assumption 
E  -  N(0,In®l)  for  some  unknown  p.d.  pxp  matrix  z ,  many  tests  of  the 
MANOVA  hypothesis  HQ:  M^  =  0  versus  Hj :  f  0  are  well  known,  e.g.  the 

likelihood  ratio  test,  Roy's  maximum  root  test,  Lawley-Hotel 1 i ng ' s  trac 
test  and  Pillai's  trace  test.  All  these  tests  ignore  X^  and  are  func¬ 
tions  of  Xj(X^X^)~^X|  (vide  Anderson  (1984)).  Moreover,  the  trace  test 
of  Pillai  (1955)  is  known  to  be  LBI  in  general  (Schwartz  (1967))  and 
UMPI  if  min(p.n^)  =  1  (Lehmann  (1959)).  On  the  other  hand,  if  M^  and 

M~  are  assumed  to  be  independent  normal  with  zero  mean  and  dispersion  o 

1  2 

and  a2z  respectively,  Roy  and  Gnanadesikan  (1959)  considered  the  prob- 

2  2 

lem  of  testing  HQ:  Oj  =  0  versus  Hjt  >  0  and  proposed  the  maximum 

root  test,  X  (X,  (X'X,)"^,' ) .  See  also  Roy  and  Cobb  (1960)  for  some 
max  1331 

related  results.  However,  so  far  no  optimum  test  is  known. 

It  is  the  object  of  this  paper  to  derive  an  optimum  invariant  test 
2  2 

for  testing  H  •  o,  =  0  versus  H,  :  o,  >0  under  the  model 


q(Z_1(X|X1/(l+o^)  +  (X2-M2)'(X2-M2)  +  X^X3)) 


for  some  q  e  Q.  Here  Q  is  the  class  of  functions  from  the  set  of  pxp 
matrices  into  [0,°°)  such  that  q  e  Q  satisfies 


,nP 


o(X'X)dX  =  1, 


(1.3) 


Gil (p)  R 


n2P 


q ( AA '  +  F 1 F ) 1 AA 1 


(n1+n3-p)/2 


dFdA  <  “ 


and 


q(BV)  =  q(VB)  for  all  V  e  L(p)  and  B  e  Gi(p)  (1.4) 

n  p 

where  F  is  a  matrix  of  order  n„xp  with  elements  in  R  ,  dF  is  Lebesgue 

n2p 

over  R  and  L( p)  is  the  set  of  pxp  nonnegative  definite  matrices.  The 

model  (1.2)  corresponds  to  (1.1)  with  only  My  as  random.  This  can  be 

thought  of  as  a  mixed  MANOVA  model  for  n^  >  0  and  a  random  MANOVA  model 

for  n^  =  0.  Of  course,  unlike  in  previous  papers  ,  the  normality  of  X  has 

been  replaced  by  a  very  general  left  orthogonally  invariant  distribution. 

We  show  that  whatever  be  q  e  Q,  the  trace  test  of  Pillai  (1955)  is  UMPI 

if  min(n3,p)  =  1  and  LBI  otherwise.  In  particular,  for  n^  =  0  which  makes 

the  model  (1.2)  comparable  to  Roy  and  Gnanadesi kan ’ s  (1959),  the  trace  test 

is  superior  to  the  invariant  maximum  root  test.  Under  normality  of  X,  it 

is  mentioned  in  Lehmann  (  1959,  page  344)  that  when  =  0  and  n^  =  n^  =  1 , 

there  exists  a  UMPI  test  under  the  group  Gy  of  all  pxp  nonsingular  lower 

triangular  matrices  with  positive  diagonal  elements.  This  test  is  based 
2  2 

on  Xyy/X3y  and,  therefore,  not  very  appealing  due  to  its  asymmetry.  Here 


Xjj  and  X^  are  the  first  components  in  the  vectors  X^  and  X^  respectively. 
It  seems  to  us  that  for  the  above  problem  the  group  Gi(p)  rather  than 
is  the  right  group  to  use.  For  some  discussion  on  properties  of  q  e  Q, 
we  refer  to  Kariya  (1981). 

The  optimum  invariant  trace  test  is  shown  to  be  null,  nonnull  and 
optimality  robust  (vide  Kariya  and  Sinha  (1985)).  It  is  interesting 
to  compare  our  results  with  those  of  Kariya  (1981)  and  Kariya  and  Sinha 
(1985)  who  proved  similar  results  under  the  fixed  effects  MAMOVA  model 
(i.e.  ,  M^  fixed  matrices),  Kariya  (1981)  requiring  q  e  Q  to  be  convex 

for  the  UMPI  property  to  hold  when  min^.p)  =  1,  while  Kariya  and  Sinha 
(1985)  restricting  q  to  belong  to  the  class  of  ellistically  symmetric  dis¬ 
tributions  and  satisfying  some  other  conditions  for  the  LB  I  property  to 
hold  when  min(n^,p)  >  1.  However  we  do  not  impose  any  condition  on  q 
other  than  the  i ntegrabi 1 i ty  condition  (1.3)  and  the  condition  (1.4). 
Moreover,  our  proof  of  the  LBI  property  of  the  trace  test  for  min(n^,p)  >  1 
is  extremely  simple  due  to  the  nature  of  the  model  (1,2).  We  refer  to 
Schwartz  (1967)  and  Kariya  and  Sinha  (1985)  for  the  LBI  property  of  the 
trace  test  under  fixed  effects  MANOVA  model  for  normal  q  and  elliptically 
symmetric  q  respectively. 

2 

If  >  0  and  M2  random  with  mean  zero  and  scale  matrix  so  that 
the  distribution  of  X  follows 


X  -  fUloj.a^E)  =  !z[""^(lwj)  *  (1«J) 


.i-n/2, 


2,~nl/2,,  .  2N'n2/2 


(1.5) 


q(z-1(  X|Xj/(  l+o 2 )  +  X^z/(\+c2)  +  X'X3)) 


a  difficulty  in  the  derivation  of  an  optimum  invariant  test  is  pointed 


5 


2.  ROBUST  OPTIMUM  INVARIANT  TEST 

Consider  the  model  (1.2)  and  the  problem  of  testing  Hq:  =  0  versus 

2  n2^ 

Hj :  Oj  >  0  where  e  R  and  z  >  0  are  unknown.  It  is  easy  to  see  that 

n?p 

the  problem  is  left  invariant  under  the  group  G  =  Gt(p)  x  R  acting  on 
2 

X  and  (M2>Z  ,a as 


gX  =  ( X,  A' ,X2A'  +  F,X3A') 


(2.1) 


g(M2,Z,a^)  =  ( M2A*  +  F.AzA1  ,a*) 

n?xp 

where  g  =  (A,F)  €  G,  A  e  G£(p),  F  e  R  .  Here  G£ ( p )  is  the  group  of 

n?xp 

pxp  nonsingular  matrices  and  R  is  the  (additive)  group  of  matrices 
of  order  n2xp.  As  a  left  invariant  measure  v  on  G,  we  take  dv(A,F)  = 

p/2  n  p  2 

d Fd A/ 1  AA •  |  M/  where  dA  and  dF  are  Lebesgue  measures  on  R  c  and  Rp  re¬ 
spectively.  Let  T(X)  be  a  maximal  invariant  under  G  and  denote  its  dis¬ 
tribution  under  by  dP^  and  under  Hq  by  dpj.  Then  applying  Wijsman's 

1  T  T 

representation  theorem  (1967),  the  ration  dp  /dP~(t(x))  =  R  (t(x))  is 

U 

given  by 


R„  (t(x) )  = 


2  (n,+nJ/2 

f(gx|a^,M2,z)!AA'l  dv(A,F) 

7 

(n,+n_)/2 

f(gx| 0 ,M2 ,Z) ! AA' 1  J  dv ( A ,  F ) 


(2.2) 


The  quantity  R  (t(x))  is  simplified  in  the  following  lemma. 
C1 

LEMMA  2.1.  The  ra tio  R  (t(x))  in  (2.2)  is  evaluated  as 

°1 

n  /  2  ,  -(n,+nJ/2 

Rn(t(x))  =  (1-n)  i Tp_nXi X1 ( X1 X1  +  X3X3)  ! 

2  2 

where  n  =  a  /( 1+c j ) . 


warn 


Proof.  The  numerator  N,  ( t (x) )  of  (2.2)  is  given  by 


N  ( t  ( x ) ) 

°1 


(2.4) 


G2(p)  R 


„  q(J_1A(XJX1/(Htj2)  +  X'X3)A' 

+  I*1(X2A'+F-M2),(X2A,+F-M2)) Iaa 


(n, +n--p)/2 


(using  (1.4)) 


2.  +  XIXJA'Z'172 


Gt(  p)  R 


)q(Z  1 /2A( x| xi/( l+a^ )  +  X3X3 


+  i'1/2(X2A'+F-M2)'(X2A'+F-M2)e"1/2) I AA ’ 

-(n.+n  )/2  „  -n,  /2 

=  \Z\  13  (l+o2)  1  . 


(n1+n3-p)/2dpdA 


Gt(  p) 


~  -1  /?  ?  (n, +n,-p)/2 

q(z  ''^(XJXj/d+aj)  +  X*X3)A’e"I/2)|.4A'|  1  3  c 


2  "nl/2,  2  ~ ( n,  +n^)/2 (• 

=  d +0 ! )  |X'Xj/(1+Oj)  +  X'XJ  1  3  I  q ( AA 1 ) ] AA ' 

JGF(p) 


ln1+n3-p)/2 


where  q( V)  =  |  q(V+F'F)dF. 
j  npP 
R  c 


Since  the  denominator  of  (2.2)  corresponds  to  N  (t(x))  with  c  =  0,  the 

°1  1 

result  follows  upon  simplification. 

Remark  2.1  .  Since  the  ratio  dP1  /dP3(t(x))  is  independent  of  q,  it 

"l  U 

follows  that  any  null  robust  test  is  also  nonnull  robust  (vide  Kariya  and 
Sinha  (1985)).  In  particular  the  optimum  invariant  test  derived  below  is 


null  and  hence  ronnull  robust. 


V  W1IWU1  U1U1U1  UW  If  » U  V  l.  \  *J\ j  -  a  "  *  -  v  -  -TT*^a 


7 

If  p  =  1  or  rij  =  1,  the  ratio  r  (t(x))  is  evidently  monotone  increasing 

in  tr  X^(X|X^  -*-  X^X^)~^xj,  the  Pillai's  trace  statistic,  which  is  the  familiar 

2 

F-statistic  for  p  =  1  and  Hotelling's  T  -statistic  for  n^  =  1.  Its  null  ro¬ 
bustness  for  arbitrary  p  and  n^,  under  the  model  (1.2),  follows  from  Kariya 
(1981).  This  proves  the  following  result. 

THEOREM  2.1.  When  min(n^,p)  =  1,  for  testing  =  0  versus 

2 

:  c ^  >  0  under  the  model  (1.2),  the  test  which  rejects  H^  for  large 
values  of  tr  X^(XjXj  +  X^X^)  ^Xj  is  UMPI ,  whatever  be  q  e  Q.  The  test  is 
null,  nonnull  and  optimality  robust. 

If  min(n,,p)  >  1,  no  UMPI  test  exists.  But  a  Taylor  series  expan¬ 
sion  of  R  (t(x))  with  respect  to  n  around  n  =  0,  coupled  with  the  obser- 
n 

vation  that 

sup  ||  xjx^xjxj  +  x'x  )_1||  <  1 

xi  ,x3 

where  ||*;|  denotes  the  Euclidean  norm,  yields 

R  (t(x) )  =  1  +  n(K  +  tr  X.(X'X,  +  x'Xj_1X'}  +  o(r)  (2.5) 

n  1  1  1  J  J  l 

where  K  is  a  constant.  For  an  invariant  test  f(t)  of  size  t,  its  local 
power  is  then  evaluated  as 

[v(t(x)  )dpj( t ( x ) )  (2.6) 

j 

=  a  +  r\tY  +  tr  X1(X|X1  +  X ' X?) _1 X j -dpj( t ( x ) )  +  0  (-  )  - 

An  application  of  the  Ueyman-Pearscn  lemma  gives  the  following  result. 

THEOREM  2.2.  When  min(nj  ,p)  1,  for  testing  -  0  versus 

2 

H^  :  >  0  under  the  model  (1.2),  the  test  which  re  jects  for  large 

values  of  Pillai's  trace  statistic  tr  Xj(XjX^  1  X1X0)  ^Xj  is  LB  I ,  whatever 


be  q  e  Q.  The  test  is  null,  nonnull  and  optimality  robust. 


Remark  2.2.  Under  the  above  setup  when  min(nj,p)  >  1.  if  A  e 
is  used  in  (2.1)  where  Gy  is  the  group  of  pxp  nonsingular  lower  triangular 

matrices  with  positive  diagonal  elements,  it  is  not  difficult  to  show  that 
the  correspond!' ng  ratio  r  (t(x))  takes  the  fi_rm 

r  (t(x))  =  1  +  n^K,  +  K„6(x)}  +  o  (n)  (2.7) 

T")  It  X 

where  K, ,  K„  (>  0)  are  constants,  o  (n)  is  o(n)  uniformly  in  x  and 

1  t  X 


P-1 


,  -1, 


(x)  =  J1tr  X1 L  i  ]  (X1  [i  ]X1[  i  ]  +  X3[i]X3[i])  X 1  [  i  ] 

i 

+  (- 


(2.8) 


n.+n^-p+l  _i 

J  -)tr  XjfXJXj  +  X^X3)  Xj 


2 


where  X^.^  is  the  nxi  submatrix  of  the  nxp  matrix  X ^  consisting  of  the 


first  i  columns  of  X ^ ,  j  =  1,  3.  It,  therefore,  follows  that  the  test 


which  rejects  HQ  for  large  values  of  f(x)  is  LBI  under  this  group.  However 


as  noted  in  the  Introduction,  this  test  suffers  from  a  serious  drawback  due 
to  its  asymmetry  in  the  use  of  the  p  columns  of  X^  and  X^. 

Going  back  to  the  other  model  (1.5),  we  note  that  under  the  null 


2 


hypothesis  HQ:  c j  =  0,  =  XjXj  +  X^X-j  and  =  X£X9  are  sufficient  for 

2 


the  nuisance  parameters  Z  and  However,  their  joint  distribution  is 

not  complete  which  can  be  seen  as  follows.  Assume  for  simplicity 


q(u)  -  1/2  exp(-tr  u/2).  Write  Tj  =  ((t|^)),  T9  =  ((tj^)).  Then 


E  ( 


=  c  but  "t,(J)t^)  -  =  o,  a.e."  does  not 


11  "22  "22  "11  '  u  uu"  "11  "22  "22  11 
hold.  This  lack  of  completeness  leads  to  the  obvious  difficulty  of  con¬ 


structing  an  optimum  invariant  test. 
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